Transient to Zero-Lag Synchronization in Excitable Networks 



H. Brama, 1 Y. Peleg, 2 W. Kinzel, 3 and I. Kanter 1,2 

1 Gonda Interdisciplinary Brain Research Center and the Goodman 
Faculty of Life Sciences, Bar-Ilan University, Ramat-Gan 52900, Israel 
2 Department of Physics, Bar-Ilan University, Ramat-Gan 52900, Israel 
3 Institute for Theoretical Physics, University of Wiirzburg, Am Hubland, 97074 Wurzburg, Germany 

(Dated: Thursday 11 th October, 2012 00:33) 

The scaling of transient times to zero-lag synchronization in networks composed of excitable units 
is shown to be governed by three features of the graph representing the network: the longest path 
between pairs of neurons (diameter), the largest loop (circumference) and the loop with the maximal 
^\^| ■ average out degree. The upper bound of transient times can vary between O(l) and 0(N 2 ), where 

N is the size of the network, and its scaling can be predicted in many scenarios from finite time 
accumulated information of the transient. Results challenge the assumption that functionality of 
£N| ■ neural networks might depend solely upon the synchronized repeated activation such as zero-lag 

synchronization. 
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PACS numbers: 84.35.+i, 87.19.1m, 87.85.dq 



The cooperative behavior of time delay networks composed of excitable units is of fundamental interest in many 
fields of science and especially in neuroscience where the building blocks of the brain, the neurons, function as 
threshold units. Psychological and physiological considerations entail that formation and functionality of neuronal cell 
assemblies depend upon the reverberation modes such as zero-lag synchronization (ZLS) [l|-[3- Several mechanisms 
for the emergence of this phenomenon have been suggested, including the global network quantity - the greatest 
common divisor (GCD) of neuronal circuit delay loops. This nonlocal phenomenon, where neurons which do not 
have common drive are synchronized, pinpoints the interplay between the network topology and the number of 
reverberating clusters, where neurons belonging to a cluster are in ZLS [H, 0|. This interplay was recently verified in 
, ^ ' an experimental procedure on a circuit of neurons embedded within a large-scale network of cortical cells in- vitro [3] 
as well as in experiments of phase locking in time-delayed coupled laser networks and networks of mutually coupled 
chaotic lasers [H, Q . 

The synchronous activity of excitable networks initiated by limited classes of external drives is nowadays well 
understood. Nevertheless, little is known about the transient times to achieve the synchronous activity. Since neural 
£^ . phenomena often occur on very short time scales, there seems to be an inherent temporal gap between the relatively 
(N( | possibly long transient trajectory to steady state pattern, and the postulate that functionality of the network is based 
on reverberating patterns only. In case transient times to reverberating modes are too long compared to the time scale 
of neural phenomena, an inference of accumulated information along the trajectory might occur in the brain activity. 
CN| ■ Furthermore, from theoretical point of view it is intriguing to know whether the synchronous mode of activity and 
the transient time are determined by the same graphical features and whether networks with the same steady state 
patterns have similar transient times. In this Letter we show that the scaling of the transient time to ZLS of excitable 
network is governed by the diameter, the circumference and the loop with the maximal average out degree. The upper 
bound of the transient to ZLS can vary between 0(1) and 0(7V 2 ), where N is the size of the network. 

The examined networks consist of N boolean neurons denoted by X(t), (Xi = {0,1}, i = 1, 2, . . . TV), where Xi = 1 
stands for an evoked spike from the i-th neuron. The dynamics of a network with homogeneous time-delays, r, can 
be described as an N dimensional iterative map 

X (t + 1) = sgn (MX (t)) = sgn {M f X (0)) (1) 

where time steps are normalized by r, sgn(-) is the signum function and M is the adjacency matrix of the graph 
representing the network, Mij = 1 iff there is a connection from neuron j to neuron z, otherwise Mij = 0. We assume 
that M represents a strongly connected graph, i.e. there is a legal path among any pair of neurons, and the GCD of 
the network loops is equal to 1. 

The transient to ZLS is defined as the minimal time steps until all neurons evoked spikes simultaneously, X(t) = 1 
and it may vary among different initial stimuli, Fig. [TJ Nevertheless, we denote by T the maximal transient time over 
all possible initial stimuli (given simultaneously to a selected subset of neurons). Quantitatively, T is defined such 
that all elements of M T are positive, sgn(M T ) = 1. Such matrices are called primitive matrices and T is known to 



be bounded by [10|,LLI] 



T < (N -l) 2 + 1 = (TV 2 ) . (2) 



2 



This upper bound transient time, T, is taken over all possible networks of size N and can be far above the actual 
transient, e.g. Fig. QJb). 

We propose that the upper bound scaling of T given by 



T = 



C 



V 



(3) 



where C and V stand for the circumference (the largest loop) and the diameter (the longest path among all the 
shortest paths between pairs of neurons), respectively, 



(4) 



ieL 



indicates the average number of generated new spikes per time-delay r while a spike is traveling along the loop L (of 
length ||L||) and 



Vrnax = max V L 
LG_loops 



(5) 



is the maximal generating rate of new spikes along a single loop in the network. The scaling, Eq. [3j is based on the 
necessary condition T > V since the initial stimulation must span over the entire network in order to achieve ZLS. 
On the other hand, by definition of the diameter, during number of V steps the initial stimulation goes through every 
possible neuron of the network. As a consequence, after V steps the initial evoked spike occupies simultaneously each 
loop and the filling progress toward ZLS is performed in parallel in the entire network loops. For TiV , the rate of 
generating new spikes is at least Vmax , Eq. (|5]), hence the time to fill the largest loop, C , is at most 0(C/Vm ax )- 
Now within V additional steps each spike occupies simultaneously each network loop and ZLS is achieved, which 
establishes the scaling - Eq. ((3]). 

To exemplify the scaling, Eq. (|3]), we first restrict the discussion to networks where C and V are of 0(1) or O(N) 
and Vmax can take one of the following orders 0(7V),0(1) or 0(N~ 1 ) as illustrated by Table HI The scaling of the 
transient time for each network was calculated using Eq. (j3j) and has been confirmed in simulations. 

Case (1) of Table HI consists of two loops of length 0(N) generating only one new spike per cycle, Vmax = q(n) ~ 
0(N~ 1 ). Hence, the transient time is dominated by the first term of Eq. (|3|) and scales as T = 0(N 2 ), saturating 
the upper bound scaling for T, Eq. (j2j). Reversing the direction of the red arrow in Table |IJl) results in a small 
loop of length 0(1), Table |T^2), characterized by Vmax — 0(1). Following Eq. (j3j), T scales now linearly with the 
system size. Adding 0(N) outgoing connections to neuron 2 of Table IHl), as illustrated in Table |T^2b), results in 
a V = O(N), although all loops of the network are still 0(N). Since 0(N) new spikes are generated at neuron 2, 
Vmax — o{n] ~ O^X) and tne transient is T = 0(N). Adding only a single self-connection to neuron 2 in the previous 
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FIG. 1: The transient time to ZLS is exemplified by the mixing argument [5|] for a network consists of 5 neurons, (a) Schematic 
of a homogeneous network where all delays are equal to r. (b) An example where the initial stimulation (t=0) is given to the 
neuron labeled by 1. Each one of the neurons mixes the colors of its driving neurons from the previous time step, e.g. neuron 4 
mixes the colors of neurons 3 and 5 from the previous time step. Red (dark) color indicates an evoked spike - an excited neuron. 
The transient time is equal to 11 in units of r. (c) An example where initial stimuli are simultaneously given to neurons 1,2 
and 3. The transient time to ZLS is equal to 5. 
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TABLE I: Illustration of the transient time, T, for networks leading to ZLS (second column) where V and C scale either as 
O(l) or as O(N). Rows (1-3) exemplify networks with P and C of O(iV) but different scaling for Vmax • Rows (4-6) exemplify 
networks where the transient is dominated by V . 



case, Table 123), the self-loop generates O(N) new spikes at each time step and Vmax = ofiy = However, an 

initial stimulus to neuron AT/2, for example, travels V = O(N) time steps before arriving at the self- loop thus the 
transient is T = O + N) = 0(N). 

Table |IJ4) represents the case where V = O(N) but C = 0(1) and each loop creates 0(1) new spikes, thus 
Vmax — 0(1). Nevertheless T = 0(N) as spikes must travel from one end of the network to the other end in order to 
achieve ZLS. Connecting all the loops to a single neuron, Table 1^5), reduces the diameter, V = 0(1), while each loop 
generates 0(N) new spikes. As a consequence, Vmax — 0(N) but as before the diameter determines the transient 
T = 0(^ + 1) = 0(1). A fully connected graph, Table 1^6), is very similar to the previous case but the circumference 
is O(N), nevertheless the transient remains T = 0(jj + 1) = 0(1). 

Finding V m ax might be an exhaustive computational task since it requires the inspection of all the network loops. 
Moreover, the transient time and its scaling can be altered by the specific type of the stimuli. Hence, we examine the 
question whether the scaling of the transient time can be predicted from finite steps of the transient. Specifically, we 
define the quantity 
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FIG. 2: Fraction of neurons which are in ZLS as a function of time for various cases and initial conditions. The (red) lightning 
denotes the position of the initial stimulation to the network and numbers inside the loops denote their lengths, (a) Linear 
growth of p(t) obtained in simulations with N — 101 for the two networks shown on the right. For T — O(N) there is an initial 
time, bounded by the diameter, where p(t) = 1/N. (b) 100 loops of length 4 and the rightmost loop is of length 5. The shape 
of p(t) and the transient time depend on the location of the stimulations. For case (1) it takes 0(T>) time steps for a spike to 
arrive at the loop of length 5 which is essential to achieve ZLS. For initial conditions (2) and (3) this time is shorter and the 
time to ZLS is reduced. 



indicating the fraction of neurons which are in ZLS at time t. Fig. [2fa) indicates that p(t) grows linearly with time for 
a case where T = 0(N 2 ). It is evident that the scaling of T can be predicted from a partial segment of the transient, 
however the generality of this consequence is in question. Fig. [2fa) exemplifies p(t) for[Il(2a) where T = O(N) and 
for a finite fraction of the transient p is constant. This plateau is originated from an initial stimulation given at a 
distance proportional to V from the junction (neuron 1, which is responsible to the production of new spikes). Similar 
plateau can occur for T = O (TV 2 ), however it is negligible as the diameter is at most O(N). Note that the scaling of 
T can be predicted also for such cases from a partial segment of the transient with a nonzero slope of p(t). 

A more structured profile for p(t) is depicted in Fig. Efb) where T is dominated by the the diameter and its shape 
is sensitive to the location of the initial stimulation. The positive slope of p(t) changes once in curve (1) and twice in 
curve (2) while curve (3) consists of only a single positive slope. The network consist of loops of length 4 only, except 
for the rightmost one which is of length 5, which is essential for GCD=1. For case (1), where the initial stimulation 
is given to the leftmost loop, the rightmost loop is first visited after O (D) time steps, but as the initial stimulation 
is moved to the right, case (2) and (3), this time is shortened. Nevertheless, the scaling of T can be predicted for all 
these examined cases from any finite segment with a positive slope of p(t). An exception class is networks with an 
out degree O(N) of at least one neuron and T — 0(N), e.g. Table |Tj2a,3). In such cases, p(t) is discontinuous as 
0{N) spikes are created at once. 

Hitherto, we have assumed that C and V are either 0(1) or O(N). However, the scaling of the transient time, Eq. 
(|3|), is valid also for and C or V of order N a , < a < 1. Such a scenario is exemplified for case (4) of Table 

U where loops are of the same order Lk = 0(N a ) , (0 < a < 1). In such a case C = O (N a ) and Vmax = O (N~ a ). 
Following Eq. ©, the transient should scale as T = O (N 2a + N) since T> = O(N). For a < 0.5 the transient is 
dominated by the diameter, T = O(N), while for a > 0.5 the transient is governed by C and V max , T = O (N 2a ). 
Figure [31(a) presents simulation results with < 2000 for the two cases (a = 1/3 and 2/3). The estimated scaling of 
the transient time is T oc A" 98 - 0(N) and T oc A" 131 - 0(N^ 3 ) respectively, which is in a good agreement with 
the theoretical prediction, Eq. ((3]). 

For the case where one of the loops scales differently, O(N^) (0 < a < f3 < 1), the transient time should scale as 
T = O (A' Q!+ ^ + A") since the generating rate of new spikes remains Vmax — O (N~ a ) but the circumference is now 
C = O (A^). A new scaling for the transient time is expected for a + f3 > 1 where the length of the loops determine 
the scaling of the transient. For the case a + /3 = 1/4 + 2/3 < 1 the transient time is dominated by the diameter 
is estimated in simulations to scale as T oc A" 101 , Fig. [3^b) , while for a + /3 = 1/2 + 2/3 > 1 the transient time is 
estimated to scale as T oc A -118 which is close to the theoretical prediction of Eq. (j3j), T = 0(N 7 / 6 ). 
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FIG. 3: Extension of the scaling of the transient time, Eq. j3j), to the case where C and V~a X are both O (N a ) , < a < 1. (a) 
The lengths of all loops scales as O (N a ), a = 1/3 (lower blue) and a = 2/3 (upper red). Simulation results indicates that for 
a = 1/3 T oc iV 0-98 - O(TV), while for a = 2/3 T oc iV 1-31 - <3(iV 4/3 ) which are both in a good agreement with the theoretical 
prediction, Eq. J3}. (b) A network where one of the loops scales differently, C — O(N^), < a < < 1. The transient time 
scales as T = 0{N^ +OL + N). For a = 1/4 (lower blue) the estimated scaling is T oc N 1 ' 01 while for a = 1/2 the estimation is 
T oc iV 1-18 , in a fairly good agreement with the scaling predicted by Eq. (|3]). 



In conclusion, the scaling law of the transient time to achieve ZLS is established as a function of only three 
properties of the network: the circumference, the diameter and the loop with maximal average out degree, where all 
these parameters can scale as O(7V a ),0 < a < 1. The scaling law was found to be a tight upper bound for many 
classes of networks but cannot be proven in general. Moreover, we have shown that typically the transient can be 
predicted from a finite steps of the transient. Finally we note that for a matrix M where the sum of each row is 
normalized to a constant, e.g. Mij = 1, it has been shown that the stability of synchronization is determined 
by the eigenvalue gap around the largest eigenvalue [12] . Similarly, the scaling of the transient time is inversely 
proportional to the eigenvalue gap. However, in our dynamics ZLS is not an eigenvector of M, hence the transient 
time is not determined by the eigenvalue gap but rather by the graphical properties of the network, Eq. ((3]). 
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